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Bernoulli random walks, a simple avalanche model, and a special branching process are essentially 
identical. The identity gives alternative insights into the properties of these basic model systems. 
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I. INTRODUCTION 

Our basic message is illustrated in the first three fig- 
ures (Figs, n 121 13) • The first shows five different ran- 
dom walks which are six steps long; the second shows 
five different avalanches of length three; the third shows 
five different simple branching processes (family trees) in 
which six individuals are born. It is not a coincidence 
that there are five examples of each. A similarity of ran- 
dom walks, avalanches and branching processes is quite 
general. The similarity becomes a near identity when a) 
the random walks are restricted to the positive integers 
which start and end at j = 1; b) the avalanche model has 
a particularly simple structure; c) The branching process 
is restricted to a case where each individual has either 
zero or two offspring. Descriptions and comparisons of 
the models follow. The near-identity of these simplest 
systems opens the door for the investigation of more com- 
plicated avalanche models and less restrictive branching 
processes. 



II. RANDOM WALKS 

A (Bernoulli) random walk on the positive integers 
{j = 1, 2, 3, • • •} is a sequence in which each integer in 
the sequence differs from the previous one by ±1 A 
specially simple set of random walks are those which start 
and end with j — 1. There is one random walk of this 
type with 2 steps, (1,2, 1), corresponding to n = 1. For 
n = 2 there are two different random walks with 4 steps, 
(1,2,1,2,1) and (1,2,3,2,1). The number of random 
walks with 2n steps which start and end at j = 1 is de- 
noted a„. Thus oo = fli = 1 and 02 = 2. There are five 
such walks for n = 3 (03 = 5). They correspond to the 
five walks shown in Fig. ^ The a„ increase rapidly with 
n. 
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A. Gambler's ruin 

This example application of the random walk on the 
positive integers dates back at least to Lagrange. With 
such a long history, it is no surprise that no really new 
results are obtained here. However, our presentation de- 
rives the a„ from a simple generating function which 
makes some calculations more streamlined. 

A random walker is initially one step away from a cliff. 
The cliff corresponds to j = and the walker's original 
position is J = 1. The walker takes steps which increase 
j (away from the cliff) with a probability q, and takes 
steps toward the cliff which decrease j with a probability 

(1-9)- 

What is the probability P{n; q) that the walker falls 
off the cliff after taking exactly 2n steps? A couple of 
examples illustrate the general result. The walker will 
immediately fall off the cliff if his first step decreases j by 
1. This disastrous step is taken with probability (l—q), so 
the probability of immediately falling is P(0; q) = (1 — 9)- 
For n = 1, the walker first takes a step in the positive 
direction (with probability q) followed by two steps in 
the negative j direction (with probabilities (l — q)). Thus 
P{l,q) = (1 — q)'^q. For n — 2 there are a2 — 2 paths 
(1, 2, 1, 2, 1) and (1, 2, 3, 2, 1) which return the walker to 
the edge after 4 steps, so P(2; q) = a2(l — q) {q{l — q))^ ■ 
From this, the generalization is clear. 

P(n;q)=a„(l-g)(g(l-g))" (1) 

Knowing the a„ described above allows one to calculate 
the probability of falling from the cliff after n steps. 

In many cases, one does not need to complete the al- 
gebra to guess the fate of the typical random walker. If 
q < 1/2, so that steps toward the cliff are more likely 
than steps away from the cliff, the walker will eventually 
fall. But if q > 1/2, the walker has a non-zero probabil- 
ity of never falling. The interesting case is the "critical" 
probability q ~ 1/2, where steps toward the cliff are just 
as likely as steps away from the cliff. The probability q is 
analogous to an order parameter associated with phase 
transitions. For example, the mean length of the random 
walk diverges as (7 — > l/2~ and the probability that the 
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FIG. 1; The five random walks on the positive integers, j, of 2n = 6 steps which start and end at j = 1. For each walk, n is 
horizontal and j is vertical. 
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FIG. 2: The five avalanches on the square lattice with length n — 3. The dark dots corresponds to a fallen dominos which can 
cause a neighbor domino in the next lower row to fall with a probability q. Two fallen dominos force the domino in the next 
lower row to fall, as can been seen in the left-hand example. 
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FIG. 3: The five branching processes in which 2n — 6 individuals are born. Each individual can have either zero or two 
offspring. 



walker will eventually fall from the cliff (the extinction 
probability of Eq. is a differentiable function of q 

except at q = 1/2; see Fig.0] 



B. Generating function 

The number of random walk paths, a„, can be obtained 
from the condition that the walker will eventually fall 
from the cliff whenever g < 1/2, which is 



oo 

^P(n;g) = l; q<- 



or using Eq. (QJ 



oo ^ 

^a„ (g(l-q))" = — 



ra=0 



q 2 



(2) 



(3) 



To obtain the coefficients a„, let 

x = qil- q) (4) 
Solving the quadratic equation in q yields 



1 



(5) 



where the negative sign is appropriate for q < 1/2. 

The "generating function" S{x) is defined to be the 
function of x which coincides with 1/(1— q) when q < 1/2. 



Using Eq. Q 



Six)^-{i-VT^) 



(6) 



More generally, the negative sign of the square root in 
the definition of S{x) means 



Returning to the sum condition on the probabilities of 
Eq. the equality of S{x) and 1/(1 - g) for q < 1/2 
means 



J2 ana;" = S{x) 



(8) 



not just for q < 1/2, but fo r all < g < 1. The Taylor 
series expansion of ^/l — Ax for < 1/4 is 

(2n)! 



Vl-4x = 1-2^ 



n+l 



n!(n + 1)! 

n— ^ ^ 



(9) 



Equating coefficients of x in the two power series obtained 
from Eq. ||SJ) gives 



(2n)! 



" n!(n + l)! 
For example, 03 = 5 as illustrated in Fig. 1. 



(10) 
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FIG. 4: The extinction probability. The upper curve de- 
scribes the random walk and the branching process. The lower 
curve describes the avalanche. 



C. Extinction 

The extinction probability E{q) is the probability that 
the walker eventually falls from the cliff, so 



(11) 



Using the series expression for the generating function, 
Eq. © 



(n) = (1 - q)x—S{x) 



(15) 



One can express (n) in terms of q using the relations 
X ^ q{l — q) , whose x—derivative gives 



(1-2,)^ = 1 
ax 

and S{x) = 1/(1 — q{x)), which yields 



(16) 



(„,Hl-,)l,(l-,)lf|^j^ (17) 

This shows the divergence of (n) as q approaches its crit- 
ical value. Simple expressions for higher moments of the 
walk length can be obtained similarly. 



E. Long walks 

The properties of the system for large n can be 
obtained from Stirling's approximation. Applied to 
Eq. 1^01), it gives 



1 



3/2 



(18) 



From this. 



P{n;q)^{l-q)^^{q{l^q)r (19) 
^/7^ n-'/^ 



When g < 1/2, we know E{q) = 1 (Eq. (0)), and it is 
also (1 - q)S{x) (Eq. (jU and Eq. ®). Using Eq. 0, 
this means 



^(^^ - ^ 1 g < 1/2 



The extinction probability for the random walk (and 
branching process) is the upper curve in Fig.0] 



The interesting properties of these probabilities occur 
near the critical value of q, so define 



(5 = 2g - 1 



(12) 

Then for small S , using 



gives 



(20) 



(21) 



D. Length 

The generating function yields the mean number of 
steps in the random walk. For q > 1/2 the mean length 
is infinite, but for q < 1/2 



nP{n, q) 



n=0 



is finite, and can be obtained from 



n=0 



\.n=0 



(13) 



(l-q)X]na„x" = (l-(z)x— (5^a„a;" ) (14) 



P{n;q) 



20Fn3/2 



exp (— (5^n) 



(22) 



Thus either a positive or negative 5 leads to an exponen- 
tial decay in the probability that the random walker will 
fall from the cliff after n steps. Of course the reason for 
the exponential decay of P(n; q) depends on the sign of 5. 
For positive S, the walker will probably be far from the 
cliff for large n. For negative (5, the walker will probably 
have already fallen for large n. Only for the critical q, 
corresponding to (5 = 0, do the probabilities decrease as 
a power in n 



P{n; 1/2) 



1 1 



(23) 
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The 3/2 exponent is a characteristic of random walks 
seen in many contexts. This exponent appears even in 
some complex many-body problems . 

At the critical q = 1/2, the probability that the walker 
survives at least n steps is obtained from summing the 
P{m; 1/2). Approximating this sum by the integral 



m—n 



P(m; 1/2) 



1 



(24) 



III. AVALANCHE 

We use the language of falling dominos for this 
avalanche model. Viewed on a diagonal, a square lattice 
of dominos is a series of rows labeled by k. The domino 
at a site in row k is influenced only by the two nearest- 
neighbor dominos in row (fc — 1). The falling probability 
of a domino depends on the number of nearest-neighbor 
fallen dominos. A domino in row k will fall with a prob- 
ability p which is 

p = no neighbor fallen in row {k — 1) 
p = q one neighbor fallen in row {k — 1) 
p = I two neighbors fallen in row {k — 1) 

The q which determines whether or not a domino with 
a single neighbor will fall plays the same role as the q in 
the random walk. 



right borders coincide, as is the case for all but one of 
the avalanches in Fig. 2. Reading an avalanche top to 
bottom and left to right yields a random walk as follows: 

1. For all avalanches, there is an initial step from j — 1 
to j = 2. 

2. After the initial step, each row of falling dominos 
in the avalanche corresponds to two steps in the 
random walk. 

3. For each row, consider first the left boundary. If 
this boundary moves to the left, the corresponding 
random walk step in j j + 1. If the left boundary 
moves to the right, j ^ j — 1. 

4. The next step in the random walk is determined 
by the right boundary of the same row of the 
avalanche. Right movement of the right boundary 
corresponds to j — > j -|- 1 and left movement of the 
right boundary corresponds to j ^ j — 1. 

5. The avalanche is terminated by a final step from 
j = 2 to J = 1. 

The avalanches in Fig. [3 correspond to the random 
walks in Fig.^ with the same order. One can check to see 
that this process works in reverse; each random walk of 
(2n) steps is associated with a unique avalanche of length 
n. The one exception is the absence of an avalanche of 
length zero. 



A. Examples 

Start with a single fallen domino. The avalanche of 
length one corresponds to no additional toppled dominos. 
Its probability is (1 — q)^ because neither neighbor of the 
initial domino falls. If the first domino causes a single 
domino in the next row to fall, but no others fall, the 
avalanche has length two. There are two such avalanches, 
corresponding to falling to the right and the left. Each 
has a probability (1 — qY (g(l — q)). The five avalanches 
of length three are shown in Fig. 2. Each of the five 
has a probability [ \ — qY [q[\ — q))^ . In general, one can 
check to see that each avalanche of length n > has a 
probability (1 — qY (^(l - 9))"^^- 

B. Equivalence 

The equivalence of avalanches and random walks is not 
complete because there is no avalanche of length zero. 
With this exception, one can ascribe a one-to-one corre- 
spondence between the avalanches and the random walks. 
As an avalanche develops, its left border moves to the 
left with a probability q , and it moves to the right with 
probability 1 — 9. Similarly, the right border moves to the 
right with probability q and to the left with probability 
1 — q. This observation is valid even when the left and 



C. Avalanche properties 

The near equivalence between avalanches and random 
walks allows us to simply derive avalanche properties. 
Two basic observations make this possible. 1) the num- 
ber of avalanches of length n > is the same as the num- 
ber of random walks with 2n steps; 2) the probability of 
an avalanche of length n, is (1 — g)^ (g(l — q))"~ , which 
is 1/g times the probability of a corresponding random 
walk. Thus the probability of any avalanche of length 
n > is (using Eq. iQJ) 

Q(n;q) = -^P{n;q) (25) 

For q < 1/2 these probabilities sum to unity, just as they 
did for the random walks. 

The length of the avalanche for q < 1/2 is obtained im- 
mediately from the length of the random walk (Eq. (|17|l 'l 



(n)^ = ^nQ(n,<z) = -^nF(n,<j) = ^-^ (26) 

n=l n=0 

where the subscript a stands for " avalanche" . For small 
q, the difference between the mean length of the random 
walk and the mean length of the avalanche reflects the 
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absence of the n = avalanche. As q approaches its 
critical value of 1/2, the mean avalanche length, {n)a 
becomes twice (n) of the random walk. 

The probability of a finite avalanche is analogous to the 
extinction probability for the random walk. For q < 1/2, 
we know that 

oo oo 

^Q(n,g) = ((l-9(x))^^a„a;"-i = l (27) 

n—l n—1 

Using the same reasoning which led to Eq. (|12|) . the re- 
placement (1 — g) ^ q yields the extinction probability 
for an finite avalanche. 

This extinction probability is the lower curve in Fig. ^ 

IV. BRANCHING PROCESS 

One of the many applications of branching processes 
is to biology. The early work of Galton and Watson 
posed the problem in the context of the survival of fam- 
ily names 2_, J?, 4] . A pseudo-biological description of the 
simplified branching process considered here postulates 
a species reproducing asexually. Each individual in this 
species has two offspring with a probability q, and zero 
offspring with a probability (1 — g) . Starting with a single 
individual, this reproduction mechanism leads to family 
trees of the type shown in Fig. 13 

A. Examples 

If the initial individual fails to reproduce, the family 
tree is a single point. This occurs with probability (l — q). 
The probability that two offspring are produced, but 
they both fail to produce a third generation is q(l — q)^. 
There are two ways that a total of four offspring could 
be produced, since either of the two first-generation de- 
scendants could produce two more individuals before the 
family dies out. The probability for each of these possi- 
bilities is q^{l — q)^. The five possible family trees which 
produce a total of six descendants are shown in Fig. 3. 
Each of these have probability g^(l — g)^. In general, each 
factor of q leads to two new individuals. The family tree 
terminates when the number of reproduction failures ex- 
ceeds the number of successes by one. Thus any family 
tree characterized by 2n descendants has a probability 
q"(l — q)""'"^. These are exactly the probabilities of the 
random walks of 2n steps. 

B. Equivalence 

One can ascribe a one-to-one correspondence between 
the branching processes and the random walks. Reading 



a family tree from top to bottom and left to right yields 
a random walk as follows: 

1. An individual reproducing corresponds to j — )■ j + 1 
in the random walk. 

2. An individual failing to reproduce corresponds to 
j ^ j — 1 in the random walk. 

3. The last individual failing to reproduce corresponds 
to a termination of the random walk. 

The family trees in Fig.|31correspond to the random walks 
in Fig. 1, with the same order. One can check to see 
that this process works in reverse; each random walk of 
2n steps is associated with a unique family tree with 2n 
descendants. 



C. Branching Process Properties 

The exact one-to-one correspondence between the 
number of descendants in the branching process and the 
number of steps in a random walk means all the results 
obtained from the random walk can be applied directly 
to the branching process. In particular, for q < 1/2, the 
mean number of descendants is exactly the same as the 
mean number of steps in the random walk. For q > 1/2 
the extinction probability of a family tree is exactly the 
same as the extinction probability, E{q) for the random 
walk. For the critical case q = 1/2, Eqs. (|^ and 
apply without alterations. Thus for large n, the proba- 
bility of the family tree terminating after 2n descendants 
are born is proportional to n~^^^ and the probability that 
at least 2n descendants are born is proportional to n~^/^. 

D. Generations 

The family trees of a branching process can be char- 
acterized by the number of generations as well as the 
number of descendants. For example, of the five family 
trees of Fig. 3, the first survives only two generations. 
The other four survive three generations. 

The properties of different generations in the branch- 
ing process can be described using a different generating 
function, /i(s), defined as 

his) ^ {1 - q) + qs^ (29) 

The term independent of s in /i(s) is the probability of 
zero descendants in the first generation, and the coeffi- 
cient of the term is the probability of two descendants 
in the first generation. A sequence of functions defined 
through iteration 

fn+l{s)=h{Ms)) (30) 

describes the properties of subsequent generations. For 
example 

/2(s) = /i (/i(s)) ^{l-q) + q{{l-q)+ qs'f (31) 
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Grouping the terms in powers of s gives 

Ms) = ((1 -q) + 1(1 - q)') + {2q^l - q)) + q\s^ 

(32) 

The term independent of s in /2(s) is the probabihty 
of zero descendants in the second generation, and the 
coefficients of is and s'^ represent the probabihties of 
two and four descendants. This pattern repeats in the 
way one would expect, and further iterations of /n(s) 
describe the probabilities in later generations. 

The recursion relation for the generations can be used 
to obtain the extinction probability. Of course, this al- 
ternative approach gives the same result as obtained in 
Eq. H12|l . but with a different insight. From the viewpoint 
of generations, the extinction probability is 



or 



E{q) - lim /fe(0) 



(33) 



because /fe(0) is the probability of zero descendants in 
generation k. Iteration of Eq. I^Hjl . staring with /i(0), 
converges to the "attractive fixed point" which is E{q). 
At the fixed point, iterations do not change the value so 



E{q) = h {E{q)) 



[l-q) + q {E{qf) = E{q) 



(34) 



(35) 



Iterations converge to the smaller of the two solutions of 
this quadratic equation. As expected, this again yields 
the extinction probability of Eq. . 

At the critical probability, q — 1/2, the extinction 
probability is unity. We can examine the rate at which 
/fc(0) approaches unity as k becomes large. Let 



gk = l-.fm 
Then the iteration of Eq. (|3U|) becomes 

1 



5fc+i = 9k 



:9l 



(36) 



(37) 



For large fc, gj- varies slowly with k and Eq. (|37|l is ap- 
proximated by 



d_ /J_ 
dk \gk 



from which 



(38) 



(39) 



Thus the probability that a family tree will survive k 
generations approaches 2/k when k is large. 

A comparison of the probability of surviving at least 
k generations and the probability of having at least n 
descendants (obtained from Eq. (|24|l 'l allows us to re- 
late the number of descendants to the number of gen- 
erations. Equating these probabilities (valid through a 
central limit theorem valid for large n and k) means 



1 



An 



(41) 



(40) 



Thus at the critical probability, a family tree which sur- 
vives a large number of generations will have produced a 
total number of individuals proportional to the square of 
the number of generations. 



V. COMMENTS 

There are several alternative methods for obtaining the 
random walk counts, a„, which play a central role in this 
work. A method analogous to the method of images is 
given in the book by Rudnick and Gaspari 0]. 

Many authors have noted the similarity of a variety 
of systems related to random walks, and our avalanche 
model is formally equivalent to a number of other mod- 
els. Domany and Kinzel described many of these rela- 
tionships in terms of generalized Ising models. In their 
language, the avalanche region described here is the "wet- 
ted" region. The avalanche is also equivalent to a "sand- 
pile" model Q. Carbone and Stanley noted that the 
avalanche can also be described as the difference of two 
random walks, corresponding to the motion of the two 
edges of the avalanche. Jonsson and Wheater ^3 rnade 
similar observations, and related real avalanches to ran- 
dom walks, but with a different physical interpretation. 

The early considerations of branching processes by 
Watson and Galton were concerned with male offspring, 
since only men (in Victorian times) preserved the fam- 
ily name. An interesting history is Kendall's article 
"Branching processes since 1873" j^. Today, applying 
the analysis to mitochondrial DNA, the concern would 
be with females. One can argue that the critical value 
of q — 1/2 for branching processes is the natural choice 
for biological applications because (over long times) most 
populations neither expand nor contract. The suggestion 
that the critical value of q is "natural" is vaguely related 
to the more general concept of "self-organized critical- 
ity" 1^3. An example paper which relates avalanches, 
self-organized criticality and branching processes is 1^. 
Of course branching processes have other applications 
where the critical q is not a natural choice. This includes 
applications to nuclear chain reactions and polymer- 
ization . More general branching processes are related 
to random walks where the changes in j are not simply 
±1. More thorough, formal and general treatments of 
branching processes are covered in a number of texts, of 
which the book by Harris |5(| is a standard. 
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